Sparsely-connected associative memory models with displaced connectivity
نویسندگان
چکیده
Our work is concerned with finding optimum connection strategies in highperformance associative memory models. Taking inspiration from axonal branching in biological neurons, we impose a displacement of the point of efferent arborisation, so that the output from each node travels a certain distance before branching to connect to other units. This technique is applied to networks constructed with a connectivity profile based on Gaussian distributions, and the results compared to those obtained with a network containing purely local connections, displaced in the same manner. It is found that displacement of the point of arborisation has a very beneficial effect on the performance of both network types, with the displaced locally-connected network performing the best.
منابع مشابه
Efficient connection strategies in 1D and 2D associative memory models with and without displaced connectivity
This study examines the performance of sparsely connected associative memory models built using a number of different connection strategies, applied to one- and two-dimensional topologies. Efficient patterns of connectivity are identified which yield high performance at relatively low wiring costs in both topologies. Networks with displaced connectivity are seen to perform particularly well. It...
متن کاملConnection strategy and performance in sparsely connected 2D associative memory models with non-random images
A sparsely connected associative memory model is tested with different pattern sets, and it is found that pattern recall is highly dependent on the type of patterns used. Performance is also found to depend critically on the connection strategy used to build the networks. Comparisons of topology reveal that connectivity matrices based on Gaussian distributions perform well for all pattern types...
متن کاملOptimal connection strategies in one- and two-dimensional associative memory models
This study examines the performance of sparsely-connected associative memory models built using a number of different connection strategies, applied to oneand two-dimensional topologies. Efficient patterns of connectivity are identified which yield high performance at relatively low wiring costs in both topologies. It is found that two-dimensional models are more tolerant of variations in conne...
متن کاملThe performance of associative memory models with biologically inspired connectivity
This thesis is concerned with one important question in artificial neural networks, that is, how biologically inspired connectivity of a network affects its associative memory performance. In recent years, research on the mammalian cerebral cortex, which has the main responsibility for the associative memory function in the brains, suggests that the connectivity of this cortical network is far ...
متن کاملGaussian and exponential architectures in small-world associative memories
The performance of sparsely-connected associative memory models built from a set of perceptrons is investigated using different patterns of connectivity. Architectures based on Gaussian and exponential distributions are compared to networks created by progressively rewiring a locally-connected network. It is found that while all three architectures are capable of good pattern-completion perform...
متن کامل